-
-
Notifications
You must be signed in to change notification settings - Fork 258
Flux2 Klein support #1261
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: flux2_base
Are you sure you want to change the base?
Flux2 Klein support #1261
Conversation
…erogar#1250) by Koratahiu --------- Co-authored-by: Koratahiu~ <[email protected]>
by Koratahiu --------- Co-authored-by: Koratahiu~ <[email protected]>
|
No 4B model? |
works with both |
|
Where is the 4B preset? |
there is none. just replace the base model name |
|
Three test runs so far and everything works fine. Did not test qwen tho. Will report in detail later with examples and stuff. Is there a way to do the in-training sampling with a different model than as defined under "model"? As in I train on the base model, but sampling happens with the distilled version. If not is this something OneTrainer should be able to do? |
keeping an entire second model in RAM isn't feasible for most people's hardware and for most models. It might be for your hardware and for the smallest models like Flux.Klein, but not generally. I'd rather have LoRA adapters that can be enabled during sampling or training, as has been used for Z-Image. The issue here is that LoRA formats are inconsistent and it's a can of worm to try to load LoRAs created by other tools. |
|
Hey, just a quick report; I trained two loras with my (as simple as possible) settings i use for SDXL and ZI and it just worked surprisingly well on the first try. Masked gave errors and my LR was a bit too high but the results match and maybe beat ZI. Thanks for all your efforts! |
|
how to train a edit lora with target images and control images? |
Flux 2 klein don't support override ? |
the shapes don't match, which is usually a sign that you've used a GGUF file but haven't selected a GGUF dtype |
not supported, mainly because we lack the UI and dataloader support in OneTrainer overall. Supporting Flux2.Klein edit trainign is easy once that exists. |

update.sh or update.bat
diffusersto a commit that includes Flux2-Klein - but that commit also fixes some bugs in their Qwen-Image pipeline. The workarounds for these bugs have to be removed in OneTrainerincludes #1237
see e50970f for code changes only in this PR